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ABSTRACT 

Certain aspects of statistical decision theory are applied to 
assessing objectively the uncertainty involved in estimating which of 
his courses of action (capabilities) an antagonist is pursuing in an 
international conflict of interest situation. Observations are made by 
a nation on its antagonist's conduct and interpreted as being associated 
with its courses of action. Bayes formula is then used to change a con- 
jectured a priori probability function over the antagonist's courses of 
action in order to estimate the course of action being pursued by the 
antagonist. A set of decision rules for selecting an appropriate course 
of action to use against an antagonist's estimated course of action is 
developed, based on preference orderings and preference quantification. 

The conclusions of this thesis are: 

(1) in spite of uncertainty concerning the course of action being 
pursued by an antagonist, it is possible to select an appropriate 
course of action to be pursued when using decision rules based 
on preference orderings and preference quantification . 

(2) that an international conflict situation may be quantitatively assess- 
ed. 

This thesis was written at the U. S. Naval Postgraduate School, 
Monterey, California, during the period January - May 1960. I am 
indebted to Professors Thomas E, Oberbeck and Franklin F. Sheehan 
for their continued patience, encouragement and most capable guidance 
while acting as faculty advisors. I wish to thank Mrs. Norma Stevens 


for her meticulous preparation of this manuscript. 
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CHAPTER I 
INTRODUCTION 

This thesis concerns itself with the application of certain aspects 
of statistical decision theory to decision making on policy implementa- 
tion at a national level. The specific application made is in the domain 
of foreign policy as it concerns two nations with a conflict of interest 
situation existing between them. 

Since World War II, the Free World under the leadership of the 
United States and the Communist Block under the leadership of the Soviet 
Union have been engaged in a struggle to determine whether the nations 
of the world will have the right to choose their own way of life and 
their own form of government or whether the leaders of the Soviet Union 
will dictate the conditions under which they will live. As yet the out- 
come of this struggle has not yet been decided but the indications are 
that we are losing this struggle, for since the close of World War II 
the Soviet Union has extended its sphere of influence over the major 
portion of the Eurasian land mass and its peoples and has begun to probe 
for handholds in South America and Africa. 

In the many small engagements that have characterized this struggle 
so far the United States has had to make many decisions. In Korea for 
example we were faced with the decisions as to how far north to allow 
our forces to proceed and whether or not to permit our aircraft the 


freedom of hot pursuit north of the Yalu River into Manchuria. Both of 


the resulting decisions made at the time were made in the face of uncertain- 


ty as to what Communist China and the U.S.S.R. would do. Hungary is an- 


other example where we were faced with the prospect of having to make a 





decision in which we were uncertain as to what our antagonist would do. 
The result in this case was that effectively we did nothing. In Cuba 
today the United States again is faced with a decision problem in which 
there is uncertainty as to what Cuba intends to do. 

It is interesting to speculate what course of action the United 
States would have pursued had it known what the intentions of its 
antagonist were in each of the above situations or, more realistically, 
had it utilized a systematic and quantitative process for objectively 
assessing the uncertainty in its estimate as to the intentions of our 
antagonist. The United TUAGOS, Ameed with information as to what course 
of action our antagonist was pursuing, might have been able to select 
a course of action, the results of which would have been more advanta- 
geous to this nation and the Free World. The word ''might" is used be- 
cause of the fact that assuming such a course of action existed, we 
might have been unwilling to pursue it since it violated our traditional 
standards. For example, a course of action which dictates starting a 
major war against Communist China would violate our tradition of not 
initiating aggressive action against another nation. 

For the foreseeable future these conflict of interest situations 
will continue to arise as part of the overall "protracted conflict" 
characterized by Strausz-Hupé, Kintner, Dougherty and Cottrell in their 
book entitled Protracted Conflict. 6 | ‘. The United States in this 


atmosphere will be repeatedly confronted with the enigma of making a 


lyumbers in brackets refer to references in the bibliography. 





decision in the face of uncertainty. 

Morton A. Kaplan, Department of Political Science, University of 
Chicago, in his book System and Process in International Politics 2 
discusses and formulates six distinct International Systems based on 
the alignment of nations and relations within this alignment which 
characterize them. In the latter portion of his book he discusses game 
theory and its relation to the "solution" of conflict of interest situa- 
tions in international politics, pointing out its limitations and draw- 
backs, 

Abraham Wald in his text entitled "Statistical Decision Functions" 
4] points out that the wimtietical decision problem can be interpreted 
as a two-person game. The author in this thesis chooses to view a con- 
flict of interest situation as a statistical decision problem, 

A conflict of interest situation involving the United States and 
the Soviet Union can be considered as a two person game in which the 
United States is a contestant playing against the Soviet Union. Both 
the United States and the Soviet Union have courses of action, designat- 
ed pure strategies in the language of game theory, which they can util- 
ize in the given situation; these courses, which also may be character- 
ized as capabilities of action, are actually a listing by the United 
States of all the possible courses of action which it considers the 
Soviet Union can pursue which are relevant to the particular situation 
being considered,as well as a listing of its own capabilities. The 
context of "course of action" is that the actions of a nation indicate 
that it will utilize the enumerated course of action to gain its 


objective, For example, troop and combat aircraft buildups in the 





vicinity of Berlin by the Soviet Union might be interpreted by the 
United States that the U.S.S.R. is pursuing a "hot war" course of 
action in the Berlin crisis, while the U.S.S.R.'s permitting United 
States aircraft to uSe routes outside the prescribed air corridors 
while in flight to Berlin might be interpreted by the United States to 
mean that the U.S.S.R. is pursuing a'cold war’ course of action in the 
Berlin crisis. 

On the other hand, the United States might construe the sending of 
its armed forces into Lebanon as its "hot war" course of action while 
the banning of trade with Communist China could be construed as its 
"cold war'' course of action. 

Inasmuch as the U.S.S.R. is not going to inform us on the courses 
of action which it is following, the advisors in the State Department 
have the problem of estimating which course of action the U.S.S.R. is 
pursuing in order to provide the President with a basis for making a 
decision on a course of action by the United States to counter that 
of the U.S.S.R. The course of action selected will be chosen relative 
to a decision criterion from the list that the United States has pre- 
pared of its capabilities, but the choice of this course of action will 
depend in part on which estimated course of action the Soviet Union is 
pursuing. 

In the theory of this thesis, the advisors, in order to make their 
estimates, assign probabilities to the courses of action of the U.S.S.R.. 
These probabilities represent the probability with which the United States 
conjectures (estimates) that the U.S.S.R. will use its courses of action 


or mixture of courses of action. A mixture of courses of action is 





interpreted as employment by the U.S.S.R. of all its courses of action 
or some subset of its courses of action where the frequency with which 
the individual courses of action are to be utilized has been carefully 
predetermined by the U.S.S.R. and the order of their employment is 
determined on a probabilistic basis. The advisors then observe the 
conduct of the U.S.S.R. and interpret specific acts as one of a set 

of possible courses of action of the Soviet Union. The observation 

of the conduct of the Soviet Union may then be used to change the 
assigned probabilities on the Soviet Union's courses of action through 
the use of Bayes theorem which provides the quantative basis for chang- 
ing these probabilities. The a priori probabilities required for the 
use of Bayes theorem are the probabilities assigned by the United States 
to the courses of action of the U.S.S.R.in an initial estimate of the 
situation. 

Bayes cheorem and statistical decision theory will help the United 
States to select the course of action it should pursue. Bayes theorem 
improves the assessment of the uncertainty as to which of the conjectured 
courses of action the U.S.S.R. is pursuing by changing the a priori pro- 
babilities of the courses of action. The changed probabilities are then 
known as a posteriori probabilities and these represent the United States’ 
estimate of the probabilities that the U.S.S.R. is utilizing these partic- 
ular courses of action. Statistical decision theory may be employed by 
representatives of the United States to choose objectively an appropri- 
ate course of action. 

The onus of "judgnent of values" is placed upon the decision maker 


who utilizes the model, which will be constructed in the next chapter, 





for formulating his decision. "Judgment of values" is particularly 
important in determining the preference pattern for the possible out- 
comes which result from the United States pursuing its courses of 
action and the U.S.S.R. pursuing its courses of action. The decision 
maker must be particularly careful that the resulting preference pat- 
tern reflects the "true" ordering of preferences of the United States 
for the outcomes and is not colored by his personal beliefs. 

The solution of the decision maker's problem rests in the final 
analysis on the selection of the "appropriate course of action" to 
counter the antagonists estimated course of action. The words "appro- 
priate course of action" are synonymous with the selection of a course 
of action which is "optimal according to the criterion established for 
making a decision.'' This criterion might be for example the maximiza- 
tion of own national interests, these interests may be construed as 
"utilities" for the possible outcomes which result from the possible 
combinations of courses of action. It may be the minimization of the 
"risks" involved in the courses of action or any criterion which has 
meaning and ''value"' to the decision maker, In any event the decision 
maker must establish the criterion and make his selection of the "“appro- 
priate’ course of action on this basis. 

The relationship between the Operations Analysis curriculum and the 
problem analyzed lies in a definition of the purpose of Operations Anal- 


ysis which is “to provide a quantitative basis for executive decision." 


Tpavapkease of a definition of the purpose of Operations Analysis. 
Robert F. Rinehart, Journal of Operations Research Society of 
America, 2, 1954. 





The author proposes that in this context, this thesis falls within 
the province of Operations Analysis. More generally, the author be- 
lieves that every person who calls himself a citizen of a country has 
an obligation to attempt to apply the discipline in which he has been 


trained to problems faced by his country. 





CHAPTER II 
GENERAL FORMULATION 
Conjecture a situation involving a conflict of interests between 
two nations, Nation I and Nation II. Nation I will be the nation making 
a decision in the face of uncertainty. Nation I has a set of two pos- 
sible courses of action (pure strategies) that it can pursue and its 
list of the possible courses of action that it estimates II can pursue 
consists of two courses of action. These courses of action are denoted 
by: 
(a), a) for I 


(b b,) for II 


‘eg 
Let the courses of action allowed have the following connotation: 


ay is interpretable as conducive to a non-shooting war or 
cold war 


is interpretable as conducive to a shooting war or hot 
war 


b, is interpretable as conducive to a non-shooting war or 
cold war 


b, is interpretable as conducive to a shooting war or 
hot war 


The possible situations which can occur may be described as: 


(a> b,); (a); bo)s (a5, b,); (ays b.) or 


(C, C), (Cc, H), (H, C), (H, H) 
Where C represents cold war and H represents hot war. 
Suppose that the order of preference for these situations by Nation 


I is represented as; 


(C, C) >(H, C) > (H, H) >> (C, 4H) 





— 


with the meaning that the situation to the left of the symbol > 
is preferred (by I) to the situations to the right. 

Subject to the general requirements of utility theory 2 : ( 
that preference shall be transitive, i.e., if A ->B and BC then 
A >C; (2) any gamble can be decomposed into its basic alternatives 
according to the rules of probability calculus; and, (3) if there ex- 
ists a gamble in which A is preferred to B and B to C, then there 
shall exist a gamble involving A and C which is indifferent to B; 


a quantification of these preferences by I can be indicated as follows: 


(C, C) = #1 
Gem - a 
(C , H) = a 


CH, CC) Sep 
with the meaning that the "value" of +1 attached to (C, C) is a stand- 
ard of preference for a desirable situation, the "value" -1 attached to 
(H, H) is a standard of preference for an undesirable situation. In the 
example being considered a has a value less than -1 and b has a value 
less than +l and greater than -l. If all possible preference patterns 
are considered, a and b are arbitrary real numbers, "values", assigned 
to the situations (C, H) and (H, C) respectively relative to the stan- 
dards +1 and -l. 
For example, we might consider a = -2 and b =+41/2 giving: 
(Cc, C) > (H, C) > (H, H) > (C, H) since 
+1 >+1/2 >-1>-2 
or if b =+5 anda = -5 
(H, C) > (C, C) > (H, H) > (C, H) since 


+5 >+1 >-1>-°-5 





A matrix representation of the conflict situation with associated pre- 
ference values assigned by I would appear as illustrated in Fig. 1 


where a and b are any real numbers 


II's courses of action 






I's courses 
of action 


Conflict Situation Matrix and "Values" assigned by I 
Figure 1 

All the numerical figures et the matrix are assigned by Nation f 
and as such are meaningful to it. They represent a value to I which 
it associates with the possible outcomes of the various combinations 
of courses of action available to I and II. These numerical values 
are intended to reflect the "utility" to I of each of the possible 
situations, in the sense described by R. Duncan Luce and Howard Raiffa 
in Games and Decisions 2 | . Nation I must choose an action based on 
its estimate of which course of action or mixtures of courses of action 
II is pursuing. I's choice will be that course of action or mixture 
of courses of action which gives it the greatest expected return. Assum- 
ing that I has no information or at best limited information on the 
course of action II is pursuing, a reasonable procedure for it to follow 
would be to observe II's actions and from these observations estimate 
what course of action II is pursuing. The observations represent the 


stochastic process of the statistical decision problem 4 ° 


An observation by I of an action by II is represented as the 


10 





occurrence of one or the other of the pair b,, b We shall 


hie 
identify this pair as Cor = (b,> b,)- The pair by and b, re- 
present the stochastic variables of the statistical decision process 
4 - If II employs a mixture of its courses of action, I may identify 
this mixture as represented in Fig. 2 where Y denotes the relative 
frequency (or odds) with which II is using b> and (1 - Y) the re- 
9° Inasmuch as I does not 
know the value of Y, but knows that Y lies in the interval (0, 1) 


lative frequency with which II is using b 


we regard Y as a stochastic variable. Y represents the true distri- 

bution, F, associated with one of the independent variables in the 

stochastic process. The valuas of Y constitute the parameter space, 
(2 » of the statistical decision problem 4 | « We shall consider 


two cases, namely Y is discrete and Y is continuous. 


M i-Y] 
ora b, b> 
Odds assigned by I to Cir 

Figure 2 
For the case where Y is discrete, only certain values in the 
interval (0, 1) are allowed; these we shall designate by the notation 


(y_ [a = 1, 2,---,N) where N is the number of discrete values of Y 


in the interval (0, 1). When Y is discrete with N values, we have a 


probability function f(y) such that Pr (Y = ye) = f(y) os Py 
: ; 

ru = 0, ie = 1. Nation I's initial a priori estimate is 
n=1 


f(y )> After I observes II's courses of action one or more times with 


the results, say, b, occurring i times and b, occurring j times, 


the resulting a posteriori distribution which will be designated £65 On? 


is given by Bayes formula to be: 
ll 





hye) yee = ae 
CaO £.1y ee 7 9 


Je ; ¢ 
a ly, va (I - ya 





Assuming stochastic independence of successive observations, the a 
posteriori probability after any set of observations becomes I's a 
prioriestimate for the next observation. Nation I's initial a priori 
estimate for the discrete case may be designated fo, 0 (y,) = f(y). 
In the discrete case we shall consider several possibilities, namely: 
Case (1). 

N # 2; Y can assume only two values say, i 0 and Yo = 
1 with probabilities Py and Po» respectively, as represented in 


Fig. 3, where the height of the vertical bars represents I's initial 


a priori estimate. 








je) 
Gere “on 
\ ee eee 
O i 
N = 2. showing probabilities that Y = ya 
Figure 3 


A numerical example of this case is worked out in Chapter III using 

an initial a priori estimate Py = f(y,) = 3/4 and P, = f(y.) 
= 1/4 The general results are that I requires only one observation 
to change its a priori estimate to ana posteriori estimate in which 


the probability one attaches to one or the other of II's courses of 


action. This is so regardless of the conjectured a priori estimate. 


12 





Case (2). 
N = 3; Y can assume only the values, say, ¥i = 0, Y> 


such that 5 | and Y¥, 1 with probabilities Pp eee 2 


’daiaaial id 


respectively, as represented in Fig. 4 where the height of 


the vertical bars represents I's initial a priori estimate. 


RIE [F 
v 
O 1 
N = 3 showing probabilities that Y = Ye 
Figure 4 


~ 


A numerical example of this case is worked out in Chapter III using 
an initial a priori probability f(y,) = 1/3, f(y.) = 1/6 and 
f(y.) = 1/2, The general results are that the a priori estimate is 
changed after one observation to an a posteriori probability in which 
non-zero probabilities are assigned to either yy and Yo OF to Yo 
and Y3° As long as the opposite action is not observed in subsequent 
observations, the probability remains distributed over aT and Yo or 
over yo and Y. with the probability on y, oF ¥, increasing with 
each observation. However,as soon as an action indicating the opposite 
course of action is observed, the a posteriori probability one attaches 
to Yoe In this situation all I knows is that II is pursuing a mixture 
of courses of action, i.e. O< Yo = 1, but the exact value of Yo he 
does not know. 
Case (3). 

N = 4; Y can assume only four values, say, y, G. Y> and 


Y3 such that 0 < Yo< ysl and Sa l with probabilities P Je 


sh oe 
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Pas ae respectively, as represented in Fig. 5, where the height of 


the vertical bars represents I's initial a priori estimate. 





> |e 1 
Y ea napa aati 
O 1 
N = 4, showing probabilities that Y = ya 
Figure 5 


A numerical example of this case is worked out in Chapter III using an 


initial a priori probability f(y,)) = 1/4, fly.) = 4, f(y.) = 
1/4, and £(y,) = 1/4. The general results are that the a priori 


Ad 


estimate is changed after one observation to an a posteriori probability 
in which all the probability is distributed over either Yy>> Yo _and 

¥3 or over yy; Y 3 and Yy° As long as the opposite action is not 
observed in subsequent observations, the probability remains distributed 
over either Yp> Yo and Y; orover yo, Y, and SA with the pro- 
bability on Y, Ory, increasing with each observation. However, as 
soon as an action indicating the opposite course of action is observed, 
the a posteriori probability assigns non-zero values to the two assumed 
mixtures Y> and Y3° In this situation all I need estimate is that 
II's mixture of courses of action lies in a sector either to the left or 
right of a mixture y* lying between Y> and Y3° The side to which 
it lies is determined by the conjectured mixture, Yo OF Ya; having 
the greatest a posteriori probability. 


We shall see in the discussion of expected return to I that if the 








quantity — lies in the interval (0,1), I need only estimate 
+ 
at] 
whether Y is greater than or less than in order to maximize 
2a par ©, 
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the expected return to him. If “ss lies outside this interval, 
I‘s course of action or mixture of courses of action which maximizes 
this expected return is uniquely determined. 

When Y is continuous we consider all possible values in the in- 
terval (0,1) and associate with this interval a probability density 
function, f(y). Nation I's initial a priori estimate when Y is 
continuous is f(y). After I observes II's courses of action one or 
more times with the results, say, by occurring i times and b, occur- 
ring j times, the resulting a posteriori probability density function 


is given by Bayes formula to be: 


=~ 
= 


Fly} y! Gr J fol) = Sa 
G2) at (y) = a gl a — ; 


i and zero @loamecre, 
| Fly) a Ls Ay 


6) 


Assuming stochastic independence of successive observations, the a 
posteriori probability density function after any set of observations 
becomes the a priori estimate for the next observation. Nation I's 
initial a priori estimate for the case where Y is continuous may be 
designated as fo 0” = f(y). As an example, if I regards all values 
of Y as equally likely, then f(y) is uniform, i.e. f(y) = 1, and 


may be shown as in Fig. 6. 


Fly) 





O 1 
Uniform density function associated with Y 


Figure 6 
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A numerical example of this case is worked out in Chapter III using 


an initial a priori density function f(y) which is uniform. The gen- 

eral results are that the a priori probability density function is chang- 

ed after each observation and the resulting a posteriori probability den- 

sity function is biased in favor of the value of Y associated with 

II's course of action, b, or bys observed the greater number of times. 
Up to this point we have been concerned with I's view of the set, 


C of courses of action, b, and b which I considers II is employ- 


1 oe 
ing with probabilities Y and (1-Y), respectively. Let us now turn our 


oD 


attention to the courses of action (a, and a.) available to I. We 


shall say that I has an action space consisting of ay and a, which 


we shall identify as C, ze (a,> a,)- Nation I will employ either of 


his courses of action ay and ay, or a mixture of his courses of action, 


selecting that course of action or mixture of courses of action which is 
"optimal" relevant to his estimate of II's behavior. In this general 
formulation of the conflict situation and the numerical examples which 
follow we shall use the criterion that I will maximize his national in- 
terests, that is to say, I will maximize the expected (average) ''value" 


of the return. We may identify, C,, as represented in Fig. 7, where 


5 ag 


x denotes the relative frequency with which I uses a, and (1-x) the 


1 


relative frequency with which he uses ay, x lies in the interval 


(0,1). 


x (L-x) 
Cy = 
~ an 


I's action space showing the relative 
frequency of use of his two courses of action 


Figure / 
16 





We use a little x in this case since we are not dealing with a 


r) +4 
stochastic variable. The quantity x is equal to ————= if a mise 
: eet 


ture of courses of action by I is indicated and 0 or 1 otherwise, 
depending on I's a posteriori estimate of Y. These three values of 


x will be discussed in the discussion on the expected "value" of the 


return to I. 


OGr matrix representation of the conflict situation, Fig. l, 


may now be represented as in Fig. 8. 





Conflict Situation Matrix showing "values" 
assigned by I and Relative Frequencies of 
C. and C__. 


if Il 
Figure 8 
The expected (average) value of the return to I is a function of 
the courses of action available to I and II which we shall designate by 


| | | | 2 
the symbol E K(C,> CD ; E|K (C,, Cry) has the meaning 


L 
that considering all the possible situations (outcomes) that can occur 
and the relative frequency with which they may occur, the expected 
"value" of the return to I is the sum over all possible situations 


which can occur with the value of each possible situation multiplied 


by the frequency of occurrence of that situation. The term "expected" 


17 





value of the return to I is not to be interpreted as the value that 

will necessarily obtain for a single occurrence of the conflict situa- 
tions in which I uses a particular course of action against his parti- 
cular estimate of the course of action II is pursuing, but rather may 
be interpreted as a ''value" of the return to I due to the uncertainty 
as to which situation will prevail. As an example, consider the con- 
flict situation represented by Fig. 8, its expected value is given by 


equation (2.3). 


(2.3) ELK(G, Cp) J =1KY tax(1-Y)+blt-x1¥ +CL)(1- x)1-Y) 








a aiveeae | ty- -2*)4 Gaol) Gusd 


atb/ A+b a+b 


The quantity E in equation (2.3) is the function that I will 
maximize with respect to x for his estimated value of Y. Fig. 9 
is a pictorial representation over the a, b plane showing the values 
for x for which E [K (Ci cm) is maximized for the situation 
represented in Fig. 8. The Fig. 9 results from a detailed analysis 
of the "gains" to I which result from all possible combinations of 
values of a and b. From equation (2.3) and Fig. 9 we see that 
the value of x which maximizes E [K (C,> Gee) | is determined not 


from the specific value of Y estimated, but rather the relationship -” 


al 


as 


of the estimated Y to the quantity 





. The values, a and b, 
it will be recalled, are the quantities assigned by I to the situations 
(c, q) and (H, C) and reflect his preferences for these outcomes of 
the conflict situation. 

nee 


Note that if Y = » indicated by the vertical dotted 
gx |e: 
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line in Fig. 9, x can be set equal to any value in the interval 
(O, 1) and the expected "value" of the return to I is the same for 


all values of x. A corresponding phenomenon occurs when I utilizes a 





je) al 
mixture of his courses of action such that x = aay and the ex- 
tx 
a +4 
pected value of the return to I is the same as when Y = es 
Pee: 


This provides I with a means of coping with a situation which arises 


when an action is required of I prior to his estimation of the course 








of action II is pursuing, for if : _ is in the interval (0,1) he 
faoy oe 
BOS g 
employs the mixture indicated by x = - = and the expected value of 
AtD 


the return to I is the same no matter which course of action II is pur- 
suing. It will be recalled from Chapter I that to use this mixture I 
must select that course of action a, or a, by means of some random 
device, such as a spinner with the circumference partitioned in pro- 
portion to the relative frequencies of utilization of ay and ays 
Fig. 9 is also a pictorial representation of I's decision rules 
for the use of his own courses of action, once he has enumerated his 
own preference ordering, for it is noted that a particular preference 


ordering is associated with only one Area of the a, b plane. For ex- 


ample, in Area I only the following preference orderings are represented: 


1. (CHC) (Cre) ear er) 
2.  (H, ©) > (Cy HW) 2G, ©) ie H) 
3. (CHC) > (Cra) 2 er) 2 a) 
4. (8) C)-~ (C, H) (me) 2 aa Bb) 
5. (PH) > GO] Ceo Uren 


where the symbol~ has the meaning that the situation to the left of the 


19 








A: skgil Beet i a i 2 | 
| O<-4! | -|<a< +0 
Lays +e tt<pe<ae 
for Y any value: x=O es see x=1 
* | ak a+b? 
3 
| eth 
| : Vaux =e 
| aro 
| 
| _ 
i —_— 
Arb 
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: for ¥ any V ahvier% =] 
ar | 
when: Y< x =O | 
arb? | 
yo , ve 4 : 
Atp? | 
if | 9°. ee 
- j | x 
| : | 
| | 
. | 
ey Ht 
A+L : 
O 8+b 1 | | O t 
| 
: 
Values of x _ for which ELK(C,, al 


and decision rules for I, 


Figure 9 
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’ a lee. nyidw Ot ® yy yo oe 


‘4 i) 


ae Oe OSE Troha? fe 4 Sane. 


Wee) 


symbol is indifferent (I has equal preference for) to the situation to 
the right. Areas II, III and IV have a similar preference pattern 


lists, but different preference ordering. 


ake 
From Fig. 9, we see that except for the special case Y = =. P 
ee 
the action to be taken by I is a, or a, corresponding to x = 1 or 
x = OQ respectively. The decision by I in favor of a, or a is based 


1 2 
on the knowledge of the "true'’ value of Y which Nation I presumably 


does not know. Nation I is therefore confronted with estimating Y, 
and with an estimate of Y he may use Fig. 9 to reach a decision in 
favor of a, or ay. In the language of statistical decision theory, 
I°s estimate of Y represents the terminal decision space, p’; the ter- 
minal decision reached by I is then used in the game theoretic analysis 
summarized in Fig. 9 to reach a point in the action space consisting of 
ay and aj. We will now turn to a consideration of I's problem of de- 
ciding upon an estimate of Y. The rules which will be developed below 
represent the statistical decision function of statistical decision 
theory. 

Let us first consider the case where Y is discrete. Suppose that 
a sufficient number of observations on II's courses of'action have been 
made so that the a posteriori probability fi we) associated with a 
particular discrete value ye is greater than or equal to some value, 
say .9, which I considers sufficient for him to decide that the particu- 
lar ve is indeed the "true" value of Y. Then I uses the value of the 
particular ve for Y to enter Fig. 9 and comes to a decision in favor 
of a Or Ane This case in the language of statistical decision theory 


1 


is the case of making a point estimate of Y. 
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The decision procedure just described requires that a sufficient 
number of observations have been made of II's actions so that one of 
the values of Y, say an has achieved a "sufficient" probability, 
say .9, to lead I to a point estimate of Y. This procedure will not 
be satisfactory in two situations. The first of these is for the case 
where Y is continuous. The second situation is the case where Y is 
discrete but the requirement for a decision by I to use a, or a, 
arises before a sufficient number of observations have been obtained 
to allow I to arrive at a point estimate of Y as described above. 
For these cases an alternate criterion is suggested, It is based on 
the maximization of the expected "value" of the return to I and the 


fact that I need only estimate whether Y is less than or greater 


than in order to select a.or a 


1 7 So as to maximize the expect- 


ed "value" of the return to him. In the discrete case I computes the 
expected "value" of the return to him for all Yn if he uses ay» 
and if he uses aos and employs his course of action which gives him 
the greater expected return. This expectation is computed with respect 
to the a posteriori probabilities. We shall symbolize this as: 
(2.4) Choose a, for which YE (sym) ti ( yn is a 
maximum for k=1],¢2., 

In the continuous case I follows a similar procedure to that described 
for the discrete case except that (2.4) becomes: 
(255) Choose a, for which | Fay ty) dy is a 

maximum for k=1.2. 


Note that this alternate criterion differs from the procedure of making 


a point estimate of Y in that it allows a decision to be made at any 
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time, i.e. before any observations have been made on II's courses of 
action or after any number of observations have been made. 

A more sophisticated method I may use in deciding upon an estimate 
Y is a complete analog of the Statistical Decision Problem considered 
by Abraham Wald 4 in which the cost of experimentation and the cost of 
a wrong decision must be considered after each observation when determin- 
ing whether to act now or take another observation. The analogous com- 
ponents for I to consider in his problem could be the "cost" of observa- 
tion, this "cost" being either real or conjectured, and the "gain" which 
would accrue to him if he took another observation. When the "cost" of 
making another observation Pieces than the "gain" to I, he makes his 


estimate of Y. This case requires that "cost" and "gain'' be commensur- 


able with a and b. It will not be considered further in this thesis. 
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CHAPTER IIT 
NUMERICAL EXAMPLES 
General Situation 
Let uS suppose that a conflict of interest situation has arisen 
between Nation I and Nation II wherein let us say Nation II is offer- 
ing to supply arms to the Beta States. Additionally, let us suppose 
that these same Beta States are engaged in open hostilities with their 
neighbor Gamma, Nation I, which has declined to supply arms to either 
side, considers that it is vital to its interests to prevent the supply 
of arms to the Beta nations. In this situation let us consider that 
Nation I has two courses of action available to it, namely: 
(1) attempt to gain its objective without resort to open hostilities. 
For example, this might be through the use of diplomatic chan- 
nels only or the United Nations. This course of action we 
Shall call ay which is equivalent to a cold war course of 
action. 
(2) attempt to gain its objective by resorting to open hostilities. 
For example, this might be through physically preventing the 
receipt of such shipments by the Beta States. This course 
of action we shall call aos which is equivalent to a hot war 
course of action. 
Similarly Nation I conjectures that Nation II has two courses of action, 
namely: 
(1) attempt to gain its objective without resort to open hostili- 
ties. This course of action we shall call b> which is 


equivalent to a cold war course of action. 
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(2) attempt to gain its objective through resort to open hostili- 
ties. This course of action we shall call b,> which is equi- 
valent to a hot war course of action. 

Having set the stage let us now proceed to examine the various cases 
discussed in the general formulation of the problem. First the case where 
Y is discrete and the three cases enumerated under it. | 
Case (1 

N = 2; Y can assume only two values, Yi and Yoi ¥y = 0 

and Ey 1 
Assumptions: 

(1) Nation I's preference ordering: 

(a> b,) = (ay, b,) > (ay, by) > (a), 54) 
or equivalently 
(cy ) CC) a (er) 

(2) Quantification of Nation I's preference ordering: 

+1 >1/2 >-1>-2 

(3) Conjectured a priori probability: 


£ 


0,0) Pree ¥,) = 3/4; 7 eee 


E002) Ss bo 


yo) = WA; ¥, = I 


Let us suppose that the first observation on Nation II's courses 
of action results in bo: The a posteriori estimate is by Bayes for- 


mula: 
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L 


Poyn) yn (L> yn)” 





Cae) ti ly,) = 
2y (yn) yn (2> y_) 
(3/4 )(1) 
Toi) = “<<a a ae 
; (3/4)(1) + (1/4)(0) 


sd (4/40) 0 
Cae 72" (7/4) (1) + (AA4)(O) 


We see that after one observation, Nation I is enabled to estimate 
that Y = O and that Nation II is pursuing its hot war course of 
action, It is interesting to note that all the a posteriori probability 


would be on yy for an observation of b regardless of the a priori 


Zz 


probability assumed and on Yo for an observation of b: 


Examination of Fig.9 shows that Nation I's prefererce pattern 


lies in Area III. In this area the decision rules for Nation I are: 


a +1 








Cy Y< * select a,, the hot war course of action. 

A+b 2 

'e) 

(2) Y> : a ; select ay the cold war course of action. 

A + 

rer lt 
In our case the quantity 22% = 2/3, and since Nation I has 
estimated that Nation II's course of action is bY = 0), the ap- 


propriate course of action for Nation I is a The expected "value" 


oa 
of the return to Nation I from equation (2.3) is E | K (CL; oe) 
= 3/2 (x + 1)- (0 - 2/3) + 1-1, which for x = O is equal to 
-l1, and for x = 1 is equal to -2., From this we also see that 


Nation I's course of action a, maximizes its expected return. 
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N= 3; Y can assume only three values Yy> Yoo and Y33 
0, Y5 where 0 = a 1, and Y, = ie 
Assumptions: 

(1) Nation I's preference ordering: 

CP Cp esc, DICE 5) 
or equivalently 
(C, C) > (H, C) > (H, H) > (C, 4) 
(2) Quantification of Nation I's preference ordering: 
tf 2 eee 

(3) Nation I conjectures that Nation II may be employing the 

mixture of its courses of action represented by y, = 3. 


(4) Conjectured a priori probability: 


fo 0%) = Pr(¥ = y,) = 13; yy a #0 
£6, 0 %2? = Pr(Y = Y») = 1/6; Y = 1/3 
fy of%3? = EEO ys eae ya 


(5) Predetermined value which the a posteriori probability must 
reach on a course of action or mixture of courses of action before 
Nation I is willing to estimate that Nation II is following that particu- 
lar course of action or mixture of courses of action is taken as .9. 

Let us suppose that the first observation on Nation II's courses 


of action results in bo: The a posteriori estimate becomes: 
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iyo 


loa) = Gsyaedyenezne warn 
(1/6) (273) 

Of) = 7 ae SS 

Oo ‘ye! (1/311) + (4/6)(2/5)* (172X0) ae 
(172)(0) 

foal ys) = ooo st COO 

O13 VSD (Vele/s)* aan © 


We see that from one observation Nation I is able to estimate 
that Nation II is pursuing either its course of action b, or the 
mixture represented by Y, * 1/3. Had the first observation result- 
ed in by» Nation I would have been able to estimate that Nation II 
was pursuing either its course of action by or the mixture represent- 
ed by ion = 3), 

Inasmuch as the a posteriori probability, that associated with 
Ya: is less than .9, Nation I makes another observation. Suppose 


that this observation again results in b,- The a posteriori pro- 


bability after this second observation is: 


£5,209) = 9/ll 
fo, 2 (¥2) — 2 1) 
£2 6%3? 2 


Since the a posteriori probability associated with yy is again less 
than .9, Nation I makes another observation and will continue to make 
observations until one of the a posteriori probabilities reaches .9. 


As long as subsequent observations do not result in b the a poster- 


}? 
iori probabilities remain distributed over yy and Y> with the probabil- 


ity over yy increasing after each observation, The total number of 


consecutive observations of b, required such that f(y) = 9; 
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is four. Therefore, Nation I, after four observations, makes a 
point estimate of Y = OQ corresponding to II's course of action 


bo. However, as soon as b is observed, the a posteriori probability 


l 
of one attaches to Yo: For example supposing the third observation 


on the actions of Nation II resulted in bas the resulting a posteriori 


probability after this observation would be: 


£29) os 0 
oo a 


Application of Bayes theorem will show that as soon as the opposite 
course of action from the one originally observed is noted, the a poster- 
iori probability of one attaches itself to Yo: In this instance we 
see that Nation I estimates that Nation [I is pursuing a mixture of its 
courses of action. 

Examination of Fig. 9 shows that Nation I's preference pattern 


lies in Area III. In this area the decision rules for Nation I are: 








a) Y< ae ; select As» the hot war course of action. 
a+ 
y+ 4 

(Zi 2 : ; select ar» the cold war course of action. 





In our case the quantity = 2/3. Therefore, for the instance 


+ 
+) 
where Nation I estimates that Nation II is following a course of action 
corresponding to Y = O, the appropriate course of action for Nation I 
is Ay. The expected value of the return to Nation I from equation (2.3) 
for x = 0 is -l andtfor x = 1 is -2. From this we also see 
that Nation I's course of action ao maximizes its expected return. 


In the instance where Nation I estimates that Nation II is follow- 


ing a mixture of courses of action corresponding to Y = 1/3, the 
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appropriate course of action for Nation I is Ans The expected value 
of the return to Nation I from equation (2.3) for x = O its -1/2 


and for x = lis -l. From this we also see that Nation I's course 


of action Ans maximizes its expected return. 
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Case (3 


N = 4; Y can agsume only 4 values Yy> Yoo Ya» and Vy? 
1 eae Yo and Y4 such that O< Yo = ¥3 = 1, “and yy = J. 
Assumptions: 


(1) Nation I's preference ordering: 

(ays, By) G5, bp) agp, 0) = (yp, 5) 
or equivalently 
(e. C)> Cie Ga, C) > Cy) 

(2) Quantification of Nation I's preference ordering: 

+1>> -1>-2>-3 

(3) Nation I conjectures that Nation II may be employing the 
mixtures of its courses of action represented by Yo = 2/7 and Y, 
= 6/7. 

(4) Predetermined value which the a posteriori probability must 
reach on a course of action or mixture of courses of action before 
Nation I is willing to estimate that Nation II is following that parti- 
cular covrse of action or mixture of courses of action is taken as .9. 


(5) Conjectured a priori probability: 


fo 0 Vp = Pr(Y = y,) = 1/4; 7 0 
oD) = Cee Yn eT 
fo, 073 = PYQl yy) eee Y, eer 
fo, 06% = TEE = yo 4 y, © 1. 


Let us suppose that the first observation on Nation II's courses 
of action results in bi The a posteriori probability after this first 


observation is: 
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cmon: 

£1 9%? = 2/15 
£1 06%? = 6/15 
Ero =e eS 


We see that from one observation Nation I is able to estimate that 
Nation II is pursuing either its course of action by or a mixture of 
its courses of action. 

Inasmuch as the greatest a posteriori probability, that associated 
with Ws is less than .9, Nation I makes another observation. Suppose 
that this observation results in b,- The a posteriori probability after 


this second observation is: 


Se ha 
£1 1%) = 5/8 
£11 %3? = 3/8 
Se See 


We see that when both of the courses of action by and b, have 


been observed, the a posteriori probability assigns zero probabilities 
oy, = O and i 1. However, had the second and all subsequent 


observations resulted in b,, the a posteriori probabilities would have 


? 
remained distributed over Yor Yq and yy, with the maximum probability on 
Ag 

Let us suppose that after two observations Nation I is required to 
implement one of its courses of action and suppose the observations have 
been by and b,. Since insufficient observations have been obtained for 
Nation I to arrive at a point estimate of Y on the basis of an a poster- 


iori probability greater than or equal to .9, I uses an alternate pro- 


cedure in order to select the appropriate course of action. This alter- 
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nate procedure is defined as follows: 
44 
(2.4) choose a, for which FEA FL Lp is a 
N=4 
miximum for k = 1,2. 


In the example under consideration we see that: 











2 Clean) fia yn) = Es yO) + E@y,' IB) * Ly, y5S/9) * Ey yy, )0) 
= fea) (x ee a |, Cena 
= [-fa+b) bx s} (ye arate Ai’ -1 ihe) 
Oia (ie ad (p11 )(a +4) ee 
- + | —. oa cael oe nem et oO peewee 2S 
L fa+b) \ —— ly a4 DJ "Aaah L S/8) 


51175 77 5 = 1 Se) x 
L+5(1-1/56/7-2/5) - 2/5 -1] (3/8) 


> -65/56 +9/56 


= 1 

and 

NY 

2,E (a2, Yn Yalyy)® E(as,y (O)+ E (A2,y2)(5/8) +E (a, yz) (9/8) + (a2. ) 

= “Gay 00 

nt N 

Since 2 Cla. y,) fi Yyn) is greater than ZE @z5y¥n) Ft5 Yn) ; 
n=1 ~ n=3 


Nation I employs his course of action aye 


In this case we see that II's mixture of courses of action having 
the greatest a posteriori probability, Yoo lies in the sector to the 


left of y* and also this same mixture is less than which is 





equal to 2/5. Under the simple criterion of selecting a point estimate 


y, for Y¥ for which the associated a posteriori probability ER 


is greatest, I would have been lead to select action a Under the 


y ia 
criterion of maximizing the expected value of return, Nation I is lead 
to selecting ays Note, however, that the a posteriori probability on 


y, is 5/8, which is less than .9. Had the a posteriori probability on 


oS 





Yo been greater than or equal to .9, Nation I would have also been 


lead to select action Ay 
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Case (4 

Y is continuous 
Assumptions: 

(1) Nation I's preference ordering: 

Geab = Gy, beeen, b, ees be 
or equivalently 
(H, C) > C, C) = (Caen Geet) 
(2) Quantification of Nation I's preference ordering: 
+5° eh > Oeil 
(3) Conjectured a priori probability density function, 


~ 
= 


f(y), uniform, t.e. f(y) = 1 for 02 y £1, and is 


zero elsewhere, 
Let us suppose that the first observation on Nation II's courses 


of action results in bi The a posteriori probability density func- 


tion is by Bayes formula, 


o( oes } 5c ee 
O22) oo an Ly) pe Oey 
an : Snare zero Gisewier-c 
Kyi ly) G-y) dy 
) 
(ny ae for O€y 41 
ee Cy) > yO = a ¥ 
» >. & ae and zero elsewhere 
(Ly (a dy 


O 


This a posteriori probability density function may be pictured as follows: 


{Cy} 


cl 


A Posteriori Probability Density Function of 
Y after observation of by 


Figure 10 
3D 





Note that as a result of the single observation, the conjectured 
a priori probability density function is changed to an a posteriori 
probability density function biased in favor of the value of 1. Had 


the observation been by the a posteriori probability density function 


would have been biased in favor of zero. 


In that case; 


EP | (1) fy)? (1-y ae For Of y¥ 4141 
ees. \ v4 ; a i ae ioe ee a as aay 


fi L > 
K1) y2" (L-y)"dy 


and zero @€1Se Ai fe 


C 


and this a posteriori probability density function may be pictured as 


follows: 
fly) 


é 


\ 


ss 


aN 
ae. 
0 


A Posteriori Probability Density Function 
of Y after observation of by 


Figure 1] 

Let us suppose that Nation I after one observation is required 
to implement one of its courses of action. Nation I uses the alter- 
nate procedure to decide which of its courses of action to utilize. 
The alternate procedure for the continuous case is: 


I 


r 
(2.5) Choose a, for which | E(a,oy) fij (yidy 


is a maximum for Kee 


In the example that we are considering we see that: 
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a+ b/ aib 





ae tary) (x 2% 
EMA y) Tyg Cy ldy : Flarb){x~2*5 \(y - 


i 
«| [=5 1-6/5 )y - V5) 46/5 -1 Je ydy 


qd: 
“| Cly-4/5) *6/5 -1 J2ydy 


a 
iE yfdy 
fo) 


and 


fare, ; 
| Elida fio ly)dy | L-510 ~O/5 Oy > |G SO oaetleicaae gay = 


cl L 
Since | E (Azsy )tyoly? dy is greater than fe A WV) too lyldy 
ra) ) 


7 


Nation I employs his course of action a 


7 ag 
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